Image taking apparatus

ABSTRACT

According to an aspect of the present invention, once the mode setting device sets the person photographing mode, and the face zooming instruction device instructs zooming to the face of the person, the detection device detects the size of the face of the person captured by the image pickup device. The zooming device is then controlled so as to capture the face of the person in a certain size based on the detection result. Subsequently, the photographer instructs zooming in the telephoto direction or the wide direction using the zooming instruction device as necessary to thereby allow fine adjustment of the composition. This enables to easily and quickly photograph an image in a user&#39;s desired composition.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image taking apparatus, and moreparticularly to an image taking apparatus with a zoom function.

2. Description of the Related Art

When photographing a person as an object, such as in the portraitphotographing, the composition is usually adjusted so that the person isphotographed in a proper size.

The composition is usually adjusted using a zoom function in a camerahaving a zoom function. However, an opportunity to press the shutter maybe missed during the zooming operation.

Under the circumstances, Japanese Patent Application Laid-Open Nos.6-217187, 2004-320286, and 6-153047 propose technologies for automaticzooming when photographing moving images of a person. The face of aperson is identified from the photographed images, and the size and theposition of the face is found such that the face of the person is alwaysphotographed in a certain size.

Japanese Patent Application Laid-Open No. 11-84481 proposes a techniquefor obtaining an image with a proper face size when photographing an IDphoto. The size of the face of an object is detected from thephotographed image, and the image is automatically contracted orexpanded such that the size of the detected face becomes a standardsize.

SUMMARY OF THE INVENTION

However, the conventional automatic zooming techniques have drawbacksthat the photographer is unable to photograph an image in a trulyintended composition because the photograph is taken in which the sizeof the face of a person is always constant. In other words, thetechniques have drawbacks that an image cannot be captured in acomposition according to the photographing scene or the preference ofthe photographer because the face of the person is always photographedin a certain size.

The present invention has been made in view of the foregoing, and anobject thereof is to provide an image taking apparatus capable of easilyand quickly photographing an image in a user's desired composition.

To attain the object, a first aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a person photographing mode; a detection device whichdetects a size of a face of a person captured by the image pickup devicein the person photographing mode; a face zooming instruction devicewhich instructs zooming of the face of the person by the zooming devicein the person photographing mode; and a control device which controlsthe zooming device in response to an instruction from the zoominginstruction device and which controls the zooming device such that thesize of the face of the person captured by the image pickup devicebecomes a certain size based on the detection result of the detectiondevice when zooming to the face of the person is instructed from theface zooming instruction device in the person photographing mode.

According to the first aspect of the present invention, once the modesetting device sets the person photographing mode, and the face zoominginstruction device instructs zooming to the face of the person, thedetection device detects the size of the face of the person captured bythe image pickup device. The zooming device is then controlled so as tocapture the face of the person in a certain size based on the detectionresult. Subsequently, the photographer instructs zooming in thetelephoto direction or the wide direction using the zooming instructiondevice as necessary to thereby allow fine adjustment of the composition.This enables to easily and quickly photograph an image in a user'sdesired composition.

To attain the object, a second aspect of the present invention providesthe image taking apparatus according to the first aspect, furthercomprising a setting device which sets the size of the face of theperson to be photographed by the image pickup device, wherein thecontrol device controls the zooming device such that the size of theface of the person captured by the image pickup device becomes the sizeset by the setting device.

According to the second aspect of the present invention, the user canarbitrarily set the size of the face of the person zoomed in response toan instruction of face zooming. This enables to more easily and quicklyphotograph an image of a person in a desired composition.

To attain the object, a third aspect of the present invention providesthe image taking apparatus according to the first aspect, furthercomprising: a second detection device which detects the size of the faceof the person captured by the image pickup device in the personphotographing mode; and an estimation device which estimates the size ofthe face of the person high in the photographing frequency based on thedetection result of the second detection device, wherein the controldevice controls the zooming device such that the size of the face of theperson captured by the image pickup device becomes the size estimated bythe estimation device.

According to the third aspect of the present invention, the tendency ofthe composition set by the user is learned. More specifically, once aphotograph is taken in the person photographing mode, the size of theface of the person photographed is detected, and the tendency of thesize of the face set by the user is estimated based on the detectionresult. In the next photographing, the zooming is controlled to obtainthe estimated face size when the face zooming is instructed. Thisenables to more quickly photograph an image of a person in the user'sdesired composition.

To attain the object, a fourth aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a group photographing mode; a detection device whichdetects positions and sizes of faces of persons captured by the imagepickup device in the group photographing mode; a face zoominginstruction device which instructs zooming to the faces of the personsby the zooming device in the group photographing mode; and a controldevice which controls the zooming device in response to an instructionfrom the zooming instruction device and which controls the zoomingdevice such that the faces of the persons captured by the image pickupdevice are shown full screen based on the detection result of thedetection device when zooming to the faces of the persons is instructedfrom the face zooming instruction device in the group photographingmode.

According to the fourth aspect of the present invention, once the modesetting device sets the group photographing mode, and the face zoominginstruction device instructs zooming to the faces of the persons, thedetection device detects the positions and the sizes of the faces of thepersons captured by the image pickup device. The zooming device iscontrolled based on the detection result such that the faces of thepersons captured by the image pickup device are shown full screen.Subsequently, the photographer instructs zooming in the telephotodirection or the wide direction using the zooming instruction device asnecessary to thereby allow fine adjustment of the composition. Thisenables to easily and quickly photograph a group photo in a desiredcomposition.

To attain the object, a fifth aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a person photographing mode; a template recordingdevice which is recorded with a plurality of person photographingtemplates with different sizes of faces; a selection device whichselects a template for use in the person photographing mode; a detectiondevice which detects a size of a face of a person captured by the imagepickup device in the person photographing mode; a face zoominginstruction device which instructs zooming of the face of the person bythe zooming device in the person photographing mode; and a controldevice which controls the zooming device in response to an instructionfrom the zooming instruction device and which controls the zoomingdevice such that the size of the face of the person captured by theimage pickup device becomes the same as the size of the face of theperson in the template selected by the selection device based on thedetection result of the detection device when zooming to the face of theperson is instructed by the face zooming instruction device in theperson photographing mode.

According to the fifth aspect of the present invention, once the modesetting device sets the person photographing mode, and the selectiondevice selects a template, while the face zooming instruction deviceinstructs zooming to the face of the person, the detection devicedetects the size of the face of the person captured by the image pickupdevice. The zooming device is then controlled based on the detectionresult such that the size of the face of the person captured by theimage pickup device becomes the same as the size of the face of theperson in the template selected by the selection device. Subsequently,the photographer instructs zooming in the telephoto direction or thewide direction using the zooming instruction device as necessary tothereby allow fine adjustment of the composition. This enables to easilyand quickly photograph an image of a person in a desired composition.

To attain the object, a sixth aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a person photographing mode; a template recordingdevice which is recorded with a person photographing template for use inthe person photographing mode; a setting device which sets a size of aface of a person in the template; a detection device which detects asize of a face of a person captured by the image pickup device in theperson photographing mode; a face zooming instruction device whichinstructs zooming of the face of the person by the zooming device in theperson photographing mode; and a control device which controls thezooming device in response to an instruction from the zoominginstruction device and which controls the zooming device such that thesize of the face of the person captured by the image pickup devicebecomes the same as the set size of the face of the person in thetemplate based on the detection result of the detection device whenzooming to the face of the person is instructed by the face zoominginstruction device in the person photographing mode.

According to the sixth aspect of the present invention, once the modesetting device sets the person photographing mode, and the face zoominginstruction device instructs zooming to the face of the person, thedetection device detects the size of the face of the person captured bythe image pickup device. The zooming device is then controlled based onthe detection result such that the size of the face of the personcaptured by the image pickup device becomes the same as the size of theface of the person in the template. The size of the face of the personin the template can be set to an arbitrary size by the setting device.This enables to more easily and quickly photograph an image of a personin a desired composition.

To attain the object, a seventh aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a group photographing mode; a template recordingdevice which is recorded with a plurality of group photographingtemplates with different distributions of the faces of persons; aselection device which selects a template for use in the groupphotographing mode; a detection device which detects positions and sizesof faces of persons captured by the image pickup device in the groupphotographing mode; a face zooming instruction device which instructszooming of the faces of the persons by the zooming device in the groupphotographing mode; and a control device which controls the zoomingdevice in response to an instruction from the zooming instruction deviceand which controls the zooming device such that a distribution of thefaces of the persons captured by the image pickup device approaches thedistribution of the faces of the persons in the template selected by theselection device based on the detection result of the detection devicewhen zooming to the faces of the persons is instructed by the facezooming instruction device in the group photographing mode.

According to the seventh aspect of the present invention, once the modesetting device sets the group photographing mode, and the selectiondevice selects a template, while the face zooming instruction deviceinstructs zooming to the faces of the persons, the detection devicedetects the positions and the sizes of the faces of the persons capturedby the image pickup device. The zooming device is then controlled basedon the detection result such that the distribution of the faces of thepersons captured by the image pickup device approaches the distributionof the faces of the persons in the template selected by the selectiondevice. Subsequently, the photographer instructs zooming in thetelephoto direction or the wide direction using the zooming instructiondevice as necessary to thereby allow fine adjustment of the composition.This enables to easily and quickly photograph a group photo in a desiredcomposition.

To attain the object, an eighth aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a group photographing mode; a template recordingdevice which is recorded with a plurality of group photographingtemplates with different numbers of persons; a selection device whichselects a template for use in the group photographing mode; a settingdevice which sets positions and sizes of faces of persons in thetemplate selected by the selection device; a detection device whichdetects positions and sizes of faces of persons captured by the imagepickup device in the group photographing mode; a face zoominginstruction device which instructs zooming of the faces of the personsby the zooming device in the group photographing mode; and a controldevice which controls the zooming device in response to an instructionfrom the zooming instruction device and which controls the zoomingdevice such that a distribution of the faces of the persons captured bythe image pickup device approaches the distribution of the faces of thepersons in the template selected by the selection device based on thedetection result of the detection device when zooming to the faces ofthe persons is instructed by the face zooming instruction device in thegroup photographing mode.

According to the eighth aspect of the present invention, once the modesetting device sets the group photographing mode, and a template isselected, while the face zooming instruction device instructs zooming tothe faces of the persons, the detection device detects positions andsizes of faces of persons captured by the image pickup device. Thezooming device is then controlled based on the detection result suchthat a distribution of the faces of the persons captured by the imagepickup device approaches the distribution of the faces of the persons inthe template selected by the selection device. The positions and thesizes of the faces of the persons in the template can be arbitrarily setby the setting device. This enables to more easily and quicklyphotograph a group photo in a desired composition.

To attain the object, a ninth aspect of the present invention providesthe image taking apparatus according to any one of the first to eighthaspects, the image taking apparatus comprising a two-step stroke shutterbutton operable to half-pressing and full-pressing, wherein thehalf-pressing of the shutter button instructs the zooming device to zooma face of a person, while the full-pressing of the shutter buttoninstructs recording of an image.

According to the ninth aspect of the present invention, thehalf-pressing of the shutter button instructs zooming of a face of aperson, and the full-pressing instructs recording of an image. Thisenables to more quickly and easily photograph an image of a person in adesired composition.

To attain the object, a tenth aspect of the present invention providesan image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a mode settingdevice which sets a group photographing mode; a template recordingdevice which is recorded with a plurality of group photographingtemplates with different distributions of the faces of persons; aselection device which selects a template for use in the groupphotographing mode; a detection device which detects positions and sizesof faces of persons from an image captured by the image pickup device inthe group photographing mode; an image processing device which cuts outan image having a substantially the same composition as a distributionof the faces of the persons in the template selected by the selectiondevice from the image captured by the image pickup device based on thedetection result of the detection device in the group photographingmode, wherein the image cut out by the image processing device isrecorded in the recording medium in the group photographing mode.

According to the tenth aspect of the present invention, once the modesetting device sets the group photographing mode, selects a template,and takes a picture, the positions and the sizes of the faces of thepersons are detected from an image captured by the image pickup device.An image having a substantially the same composition as the distributionof the faces of the persons in the selected template is cut out from thecaptured image based on the detection result, and the cut out image isrecorded in the recording medium as a photographic image. This enablesto more easily and quickly photograph a group photo in a desiredcomposition.

To attain the object, an eleventh aspect of the present inventionprovides an image taking apparatus which records an image captured by animage pickup device in a recording medium in response to an imagerecording instruction, the image taking apparatus comprising: a modesetting device which sets a group photographing mode; a templaterecording device which is recorded with a plurality of groupphotographing templates with different numbers of persons; a selectiondevice which selects a template for use in the group photographing mode;a setting device which sets positions and sizes of faces of persons inthe template selected by the selection device; a detection device whichdetects positions and sizes of faces of persons captured by the imagepickup device in the group photographing mode; an image processingdevice which cuts out an image having a substantially the samecomposition as a distribution of the faces of the persons in thetemplate selected by the selection device from the image captured by theimage pickup device based on the detection result of the detectiondevice in the group photographing mode, wherein the image cut out by theimage processing device is recorded in the recording medium in the groupphotographing mode.

According to the eleventh aspect of the present invention, once the modesetting device sets the group photographing mode, selects a template,and takes a picture, the positions and the sizes of the faces of thepersons are detected from an image captured by the image pickup device.An image having a substantially the same composition as the distributionof the faces of the persons in the selected template is cut out from thecaptured image based on the detection result, and the cut out image isrecorded in the recording medium as a photographic image. The positionsand the sizes of the faces of the persons in the template can be set toarbitrary positions and sizes by the setting device. This enables tomore easily and quickly photograph a group photo in a desiredcomposition.

According to the present invention, an image can be easily and quicklyphotographed in a user's desired composition.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a front perspective view of an external configuration of anelectronic camera;

FIG. 2 is a back perspective view of an external configuration of theelectronic camera;

FIG. 3 is a block diagram of an electric configuration of the electroniccamera;

FIG. 4 is a flow chart of the procedure of operations of photographingand recording by the electronic camera in the person photographing mode;

FIG. 5 is a flow chart of the procedure of operations of photographingand recording by the electronic camera when zooming the face with a facezooming button;

FIG. 6 is a flow chart of the procedure of operations of photographingand recording by the electronic camera when zooming the face until theshutter button is half-pressed;

FIGS. 7A and 7B depict one example of a method of setting the size ofthe face of a person zoomed during the face zooming;

FIG. 8 is a flow chart of the procedure of operations of estimating thesize of the face high in the setting frequency based on the user'sphotographing results of the past and automatically zooming to the sizeto take a picture in the person photographing mode;

FIGS. 9A to 9C depict one example of a method of setting the size of theface of a person zoomed during the face zooming;

FIG. 10 is a flow chart of the procedure of operations when using atemplate to zoom the face;

FIG. 11 is a flow chart of the procedure of operations in which azooming process is always conducted such that the face of the personbecomes the size of the face of the person in the selected template;

FIG. 12 is a flow chart of the procedure of operations in which azooming process is conducted such that the face of the person alwaysbecomes the size of the face of the person in the selected template;

FIGS. 13A and 13B depict one example of a method of arbitrarily settingthe position and the size of the face of a person in a template on thescreen of the monitor;

FIGS. 14A and 14B are schematic diagrams of the process in a group photophotographing mode;

FIG. 15 is a flow chart of the procedure of operations of photographingand recording by the electronic camera in the group photo photographingmode;

FIGS. 16A and 16B depict one example of a method of setting the range ofillustrating the faces of persons on the screen of the monitor;

FIGS. 17A to 17F depict one example of templates for use in the groupphoto photographing mode;

FIG. 18 is a flow chart of the procedure of operations when zooming thefaces in a group photo using a template;

FIGS. 19A and 19B are one example of a method of arbitrarily setting thepositions and the sizes of the faces of persons in a template on thescreen of the monitor;

FIGS. 20A to 20C are schematic diagrams of the process in the groupphoto photographing mode of the electronic camera according to a thirdembodiment; and

FIG. 21 is a flow chart of the procedure of operations of photographingand recording in the group photo photographing mode of the electroniccamera according to the third embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The preferred embodiments of an image taking apparatus of the presentinvention will now be described with reference to the accompanyingdrawings.

FIGS. 1 and 2 are a front perspective view and a back perspective viewrespectively, showing an external configuration of one embodiment of anelectronic camera in which the present invention is applied.

As shown in FIGS. 1 and 27 a camera body 12 of this electronic camera 10is formed in a thin rectangular box-shape.

As shown in FIG. 1, a photographic lens 14, a strobe unit 16, aself-timer lamp 18, an AF auxiliary lamp 20, and so forth are arrangedon the front side of the camera body 12. A shutter button 22, a powerbutton 26, and so forth are arranged on the upper surface.

Meanwhile, as shown in FIG. 2, a monitor 28, a zoom button 30, aplayback button 32, a DISP/BACK button 34, a cross button 36, a MENU/OKbutton 38, and so forth are arranged on the back side of the camera body12.

Although not shown, a tripod screw hole and a battery cover which can befreely opened and closed are arranged on the bottom of the camera body12. A battery storage chamber for storing a battery and a memory cardslot for mounting a memory card are arranged inside the battery cover.

The photographic lens 14 is constituted by a collapsible AF zoom lensand is drawn out from the camera body 12 as the power of the electroniccamera 10 is turned on. The zoom mechanism and the collapse mechanism ofthe photographic lens 14 are known in the art, and thus, specificconfigurations will not be described. The strobe unit 16 is constitutedby, for example, a xenon tube and emits light as necessary duringphotographing.

The self-timer lamp 18 is constituted by, for example, LED, and emitslight and flickers in a predetermined manner during self-timerphotographing to notify the object of the photographing timing.

The AF auxiliary lamp 20 is constituted by, for example, high intensityLED and emits light as necessary during AF.

The shutter button 22 is constituted by a two-step stroke press buttonconsisted of so-called “half-press” and “full-press”. Duringphotographing, when the shutter button 22 is half-pressed, theelectronic camera 10 prepares for photographing, in other words,performs AE (Automatic Exposure) and AF (Auto Focus). When the shutterbutton 22 is full-pressed, the electronic camera 10 performs actualphotographing, in other words, photographs and records an image.

The power button 26 is used for turning ON/OFF the power of theelectronic camera 10, and when pressed for a fixed time (for example, 2seconds, which is called long-pressing), the power of the electroniccamera 10 is turned ON/OFF.

The monitor 28 is constituted by color LCD. The monitor 28 is used as animage display unit for displaying captured images and as a GUI duringvarious kinds of settings. During photographing, images captured by animaging element are through-displayed, and the monitor 28 is used as anelectronic view finder.

The zoom button 30 is used for instructing zooming and is constituted bya zoom telephoto button 30T for instructing zooming in the telephotodirection and a zoom wide button 30W for instructing zooming in the widedirection. The zoom button 30 is used for instructing expansion andcontraction of a playback image during the playback of an image. Theplayback image is magnified and displayed when the zoom telephoto button30T is pressed, while the playback image is contracted and displayedwhen the zoom wide button 30W is pressed.

The playback button 32 is used for instructing switching to the playbackmode. When the playback button 32 is pressed during photographing, theelectronic camera 10 is switched to the playback mode. If the playbackbutton 32 is pressed for a fixed time (so-called long-pressing) when thepower is OFF, the electronic camera 10 is activated in the playbackmode.

The cross button 36 is designed to be able to be pressed in the verticaland horizontal four directions. A function is allocated to eachdirection of the cross button 36 in accordance with the state of thecamera. For example, during photographing, a function for switchingON/OFF the macro function is allocated to the left button, while afunction for switching the stroboscopic mode is allocated to the rightbutton. A function for changing the brightness of the monitor 28 isallocated to the upper button, while a function for switching ON/OFF theself-timer is allocated to the lower button. During the playback, aframe advance function is allocated to the left button, while a frameback function is allocated to the right button. A function for changingthe brightness of the monitor 28 is allocated to the upper button, whilea function for deleting the playback image is allocated to the lowerbutton. During various kinds of settings, a function for moving thecursor displayed on the monitor 28 in the direction of each button isallocated.

The MENU/OK button 38 is used for loading the menu screen (MENUfunction), confirming the selection, instructing the execution of aprocess (OK function), and the like. The allocated function is switchedin accordance with the state of the electronic camera 10.

In the electronic camera 10 of the present embodiment, various kinds ofsettings of the camera are executed on the menu screen loaded on themonitor by pressing the MENU/OK button 38. Examples of the settingsrelated to photographing include setting of the image size (the numberof recorded pixels), setting of the photographic sensitivity (AUTO, 100,200, 400, 800, 1600, or the like), setting of the type of opticalmeasurement (spot metering, center-weighted metering, multi-patternmetering, and the like), setting of the color saturation(high/medium/low), setting of the sharpness (high/medium/low), settingof the white balance mode (auto, manual, shade, fair weather, cloudy,incandescent light, fluorescent light, or the like), setting of the AFsystem (single AF, continuous AF, or the like), setting of thecontinuous shooting (ON/OFF), setting of the AE mode (auto, program AE,aperture priority AE(A), shutter speed priority AE(S), manual AE(M),scene program AE(SP), or the like), and setting of the scene program AE(“person photographing mode” for photographing a person, “landscapephotographing mode” for photographing a landscape, “sports photographingmode” for photographing a sport, “night scene photographing mode” forphotographing a night scene, “underwater photographing mode” forphotographing in water, “group photographing mode” for photographing agroup photo, or the like). Examples of the settings related to playbackinclude deletion of an image (one-frame deletion of the display image,all-frame deletion, or the like), formatting of a memory card, andsetting of a DPOF. Examples of basic setting items of the camera includesetting of date and time, setting of the shutter sound (ON/OFF), settingof the shutter volume (large/medium/small/OFF), setting of the operationvolume (large/medium/small/OFF), and setting of the brightness of themonitor.

The DISP/BACK button 34 is used for instructing switching of the display(DISP function) of the monitor 28 and for instructing canceling and thelike (BACK function) of the input operation. The function allocated isswitched in accordance with the setting condition of the electroniccamera 10.

FIG. 3 is a block diagram of an electric configuration of the electroniccamera 10 of the present embodiment.

As shown in FIG. 3, the electronic camera 10 comprises a CPU 110, anoperation unit 112 (shutter button 22, mode lever 24, power button 26,zoom button 30, playback button 32, DISP/BACK button 34, cross button36, MENU/OK button 38, and the like), a ROM 114, a RAM 116, an EEPROM118, a VRAM 120, a photographic lens 14, an imaging element 128, atiming generator 130, an analog signal processing unit 132, an A/Dconverter 134, an image input controller 136, an image signal processingunit 138, a compression/expansion processing unit 140, a mediacontroller 144, a memory card 146, a display control unit 148, an AEdetection unit 152, an AF detection unit 154, a strobe control unit 156,an AF auxiliary lamp control unit 158, a power control unit 160, abattery 162, a face detection unit 164, and so forth.

The CPU 110 controls individual parts of the electronic camera 10 incompliance with a predetermined control program based on the input fromthe operation unit 112. The control program executed by the CPU 110,various data needed for the control, and the like are stored in the ROM114. Information of various kinds of settings and the like such asinformation set by the user is stored in the EEPROM 118.

The RAM 116 is used as a work area of the CPU 110 and as a temporarystorage area of image data, while the VRAM 120 is used as a temporarystorage area dedicated for the image data for display.

The photographic lens 14 is constituted by the AF zoom lens asdescribed, and includes a zoom lens 14 z for zooming, a focus lens 14 ffor focusing, and an aperture 14 i for adjusting the quantity of light.

The zoom lens 14 z is driven by a zoom motor 124 z and moves back andforth on the optical axis. This optically changes the magnification ofan object image formed on the light receiving surface of the imagingelement 128. The CPU 110 controls the zoom motor 124 z through the zoommotor driver 126 z to control the movement of the zoom lens 14 z,thereby controlling zooming.

The focus lens 14 f is driven by the focus motor 124 f and moves backand forth on the optical axis. The focus lens 14 f is thus focused. TheCPU 110 controls the focus motor 124 f through the focus motor driver126 f to control the movement of the focus lens 14 f, thereby focusingthe focus lens 14 f.

The aperture 14 i is constituted by, for example, an iris diaphragm, anddriven and operated by an iris motor 124 i. The CPU 110 controls theiris motor 124 i through the iris motor driver 126 i to control theoperation of the aperture 14 i, thereby controlling the quantity ofincident light on the light receiving surface of the imaging element128.

The imaging element 128 is constituted by a CCD image sensor having apredetermined RGB color filter array, and is driven and operated by thetiming generator (TG) 130. More specifically, the imaging element 128uses a drive pulse provided by the timing generator 130 to read out thesignal charges accumulated in individual pixels (photo sensors) andsequentially outputs a voltage signal (analog image signal) inaccordance with the signal charges. The imaging element 128 uses ashutter gate pulse provided by the timing generator 130 to discharge thesignal charges accumulated on individual pixels to the shutter drainthrough the shutter gate. The charge accumulation time of individualpixels can be controlled by controlling the discharge, allowing controlof the exposure time or the shutter speed. The CPU 110 controls theimaging element 128 through the timing generator 130 to control thereading out of the charge accumulation time (shutter speed) and theimage signal.

The analog signal processing unit 132 performs correlated doublesampling to the analog image signal outputted from the imaging element128, and amplifies and outputs the image.

The A/D converter 134 converts the analog image signals of R, C, and Boutputted from the analog signal processing unit 132 into digital imagesignals and outputs them.

The image input controller 136 contains a predetermined capacity of linebuffers, and accumulates image signals of one frame outputted from theA/D converter 134 in accordance with an instruction from the CPU 110 andstores the image signals in the RAM 116.

The image signal processing unit 138 comprises a synchronization circuit(processing circuit which interpolates the spatial dislocation of acolor signal associated with the color filter array of the single-plateCCD and which simultaneously converts the color signal), a white balancecorrection circuit, a gamma correction circuit, a contour correctioncircuit, a luminance/color-difference signal generation circuit, and thelike. The image signal processing unit 138 imports an image signalstored in the RAM 116 through the image input controller 136 incompliance with an instruction from the CPU 110 and performs requiredsignal processing to generate an image signal (Y/C signal) constitutedby a luminance signal (Y) and color-difference signals (Cr and Cb). Thegenerated image signal image data is stored in the RAM 116 and the VRAM120.

The compression/expansion processing unit 140 imports the Y/C signalgenerated by the image signal processing unit 138 from the RAM 116 incompliance with an instruction from the CPU 110 and performs apredetermined compression process to generate compressed image data in apredetermined form (for example, JPEG). The compression/expansionprocessing unit 140 imports the compressed image data in compliance withan instruction from the CPU 110 and performs a predetermined expansionprocess to generate an uncompressed Y/C signal.

The media controller 144 controls reading/writing of data to the memorycard 146 mounted on a media slot in compliance with an instruction fromthe CPU 110. For example, the media controller 144 records image dataobtained by photographing in the memory card 146 and reads out the imagedata recorded in the memory card 146 in response to a readoutinstruction.

The display control unit 148 controls display of the monitor 28 incompliance with an instruction from the CPU 110. More specifically, thedisplay control unit 148 imports a Y/C signal from the VRAM 120 incompliance with the instruction from the CPU 110, and converts the Y/Csignal into a signal format for displaying on the monitor 28 (forexample, NTSC signal, PAL signal, or SCAM signal) and outputs it to themonitor 28. Additionally in compliance with an instruction from the CPU110, the display control unit 148 outputs information such as character,symbol, and figure (predetermined operation information or menu screen,imaging information during photographing (aperture value, shutter speed,imaging sensitivity, possible number of photographs, battery powerremaining, date and time information, and the like), AF frame denoting afocus area, imaging auxiliary lines denoting horizontal and verticallines, playback information during playback (frame number, totalphotographs taken, imaged date and time, battery power remaining, andthe like), error messages on the occurrence of errors, and the like) onthe monitor 28.

The AE detection unit 152 imports an image signal stored in the RAM 116through the image input controller 136 in compliance with an instructionfrom the CPU 110 and calculates integrated values required for the AEcontrol. More specifically, the detection unit 152 divides one screeninto a plurality of areas (for example, eight by eight) and calculatesthe integrated values of image signals of R, G, and B of each dividedarea. During the AE control, the CPU 110 finds the brightness of theobject based on the integrated values obtained from the AE detectionunit 152 and calculates an exposure value (EV value) suitable forphotographing. The CPU 110 then determines the aperture value and theshutter speed from the calculated EV value in accordance with apredetermined program diagram.

The AF detection unit 154 imports image signals of R, G, and B stored inthe RAM 116 through the image input controller 136 in compliance with aninstruction from the CPU 110 and calculates the focus evaluation valuerequired for the AF control. The AF detection unit 154 includes ahigh-pass filter which only passes high frequency components of Gsignal, an absolute value acquiring processor, a focus area extractingunit which cuts out a signal in a predetermined focus area set on thescreen, and an integration unit which integrates absolute value data inthe focus area. The AF detection unit 154 outputs the absolute valuedata in the focus area integrated by the integration unit to the CPU 110as a focus evaluation value. During the AF control, the CPU 110 searchesthe position where the focus evaluation value outputted from the AFdetection unit 154 becomes the maximum and performs focusing by movingthe focus lens 14 f to the position.

The strobe control unit 156 controls light emission of the strobe unit16 in compliance with an instruction from the CPU 110.

The AF auxiliary lamp control unit 158 controls light emission of the AFauxiliary lamp 20 in compliance with an instruction of the CPU 110. Morespecifically, if the CPU 110 determines during AF that the object isdark or determines that the contrast of the object is low, the CPU 110causes the AF auxiliary lamp 20 to emit light through the AF auxiliarylamp control unit 158 and causes the AF auxiliary lamp to be directed tothe object to perform the AF control.

The power control unit 160 controls power supply to individual partsfrom the battery 162 in compliance with an instruction from the CPU 110.

The face detection unit 164 imports the Y/C signal generated by theimage signal processing unit 138 from the RAM 116 in compliance with aninstruction from the CPU 110 and detects the face area of the personfrom the photographed image.

The method of detecting the face from an image is known in the art, andtherefore, the description of the specific method will be omitted.Methods of detecting the face include, for example, a method of patternmatching with a face template, a method of extracting flesh-color datafrom the original image to extract a cluster of photometric points asthe face, the photometric points determined to be in a flesh-colorrange, a method of converting the photometric data into hue and colorsaturation to create the two-dimensional histogram of the convertedhue/color saturation and analyzing it to determine the face area, amethod of extracting a face candidate area equivalent to the shape ofthe face of the person to determine the face area from the amount offeatures in the area, and a method of extracting the contour of the faceof the person from the image to determine the face area.

In the person photographing mode, the CPU 110 adds an image (forexample, image for through display) obtained from the imaging element128 to the face detection unit 164 before the actual photographing anddetects the face of the person. The CPU 110 then performs the AF controlsuch that the detected face is in focus and performs the AE control suchthat the face is in a proper brightness. The CPU 110 processes the imageobtained by photographing, the process suitable for the image of theperson. For example, the CPU 110 processes the image by adjusting thebrightness, color saturation, sharpness, and the like, so that the skinof the person looks beautiful.

In the person photographing mode, the CPU 110 calculates the positionand the size of the face of the person in the image based on thedetection result of the face detection unit 164 and controls zooming sothat the face is photographed in a certain size. The control of zoomingis conducted in response to the half-press of the shutter button 22.

This concludes the description the configuration of the electroniccamera 10 of the present embodiment.

The effects of the electronic camera 10 of the present embodimentconfigured as mentioned above will now be described.

The basic operations of photographing and recording by the electroniccamera 10 of the present embodiment will be described first.

Once the power button 26 is pressed, the electronic camera 10 isactivated under the photographing mode.

The zoom motor 124 z is driven by the zoom motor driver 126 z, and thephotographic lens 14 is drawn out to a predetermined position. Once thephotographic lens 14 is drawn out to the predetermined position,through-the-lens images are displayed on the monitor 28. Morespecifically, the imaging element 128 continuously captures images, theimage signals are continuously processed, and the Y/C signals arecontinuously generated. The generated Y/C signals are sequentially addedto the display control unit 148 through the VRAM 120, converted to asignal format for display, and outputted to the monitor 28. This leadsto a through-display of the images captured by the imaging element 28through the photographic lens 14 on the monitor 28.

The photographer checks the through-the-lens images displayed on themonitor 28 to determine the composition and then half-presses theshutter button 22.

When the shutter button 22 is half-pressed, a S1 ON signal is inputtedto the CPU 110. The CPU 110 prepares for photographing in response tothe S1 ON signal, more specifically, performs the processes of AE andAF.

The image signal outputted from the imaging element 128 is imported tothe RAM 116 through the analog signal processing unit 132, the A/Dconverter 134, and the image input controller 136 and added to the AEdetection unit 152 and the AF detection unit 154.

The AE detection unit 152 calculates the integrated values required forthe AE control based on the inputted image signal and outputs theintegrated values to the CPU 110. The CPU 110 finds the brightness ofthe object from the integrated values obtained from the AE detectionunit 152 and calculates the imaging EV. The CPU 110 then determines theaperture value and the shutter speed during the actual photographingfrom the imaging EV value in accordance with the predetermined programdiagram.

The AF detection unit 154 calculates the focus evaluation value requiredfor the AF control based on the inputted image signal and outputs thefocus evaluation value to the CPU 110. The CPU 110 controls the focuslens motor 124 f based on the output from the AF detection unit 154 andcontrols the movement of the focus lens 14 f to focus the main object.In this case, the CPU 110 causes the AF auxiliary lamp 20 to emit lightas necessary.

The photographer checks the through-the-lens images displayed on themonitor 28 to check the focus. The photographer operates the zoom button30 as necessary to determine the composition. Once the object which thephotographer wants to photograph is in focus, and the composition isdetermined, the photographer instructs the actual photographing, inother words, fully presses the shutter button 22.

As the shutter button 22 is full-pressed, an S2 ON signal is inputted tothe CPU 110. The CPU 110 performs photographing and recording inresponse to the S2 ON signal.

The imaging element 128 is exposed in the aperture value and the shutterspeed obtained from the AE process, and the image signal for recordingis imported.

The image signal of one frame outputted from the imaging element 128 isimported to the image input controller 136 through the analog signalprocessing unit 132 and the A/D converter 134, and stored in the RAM116. The image signal stored in the RAM 116 is added to the image signalprocessing unit 138 under the control of the CPU 110. The image signalprocessing unit 138 conducts predetermined signal processing on theinputted image signal and generates an image signal (Y/C signal)consisted of a luminance signal (Y) and color-difference signals (Cr andCb).

The Y/C signal generated by the image signal processing unit 13 g istemporarily stored in the RAM 116 and later added to thecompression/expansion processing unit 140. The compression/expansionprocessing unit 140 conducts predetermined compression processing to theY/C signal and generates compressed image data in a predetermined form.

The compressed image data generated by the compression/expansionprocessing unit 140 is stored in the RAM 116. The CPU 110 generates astill image file (for example, Exif) in a predetermined format in whichpredetermined attached information (photographing conditions such asaperture value, shutter speed, and sensitivity or various information inrelation to photographing such as photographed date and time) is addedto the compressed image data stored in the RAM 116. The CPU 110 recordsthe still image file in the memory card 146 through the media controller144.

This concludes the description of the basic operations of photographingand recording of the electronic camera 10 of the present embodiment.

An operation of playing back of recorded images in the electronic camera10 of the present embodiment will now be described.

The images recorded in the memory card 146 can be played back anddisplayed on the monitor 28 by setting the mode of the electronic camera10 to the playback mode. Switching to the playback mode is conducted bypressing the playback button 32.

Once the playback button 32 is pressed, the CPU 110 reads out thecompressed image data of the image file recorded lastly in the memorycard 146 through the media controller 144.

The compressed image data read out from the memory card 146 is added tothe compression/expansion processing unit 140, and converted touncompressed image data and added to the VRAM 120. The data is outputtedto the monitor 28 from the VRAM 120 through the display control unit148. As a result, the images recorded in the memory card 146 are playedback and displayed on the monitor 28.

The frame advancing of the images is conducted by operating the left andright keys of the cross button 36. When the right key is operated, thenext image file is read out from the memory card 146, which is thenplayed back and displayed on the monitor 28. When the left key of thecross button 36 is operated, the prior image file is read out from thememory card 146, which is then played back and displayed on the monitor28.

The images recorded in the memory card 146 are played back as described.

As mentioned above, when the photographing mode is set to the personphotographing mode in the electronic camera 10 of the presentembodiment, the face of the person is detected from the imagesphotographed for the through display, and the AF control is conducted soas to focus the detected face, while the AE control is conducted suchthat the face is in a proper brightness. The automatic zooming isconducted so that the detected face becomes a certain size. When theactual photographing is performed, the image processing suitable for theimage of person is performed to the image obtained by the actualphotographing.

The operations of photographing and recording by the electronic camera10 of the present embodiment in the person photographing mode will nowbe described.

FIG. 4 is a flow chart of the procedure of operations of photographingand recording by the electronic camera 10 of the present embodiment inthe person photographing mode.

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S10).

As described, the setting of the person photographing mode is conductedby selecting the items of setting the AE mode and the scene program AEon the menu screen. More specifically, the setting is conducted byselecting the items of setting the AE mode and the scene program AE onthe menu screen, setting the AE mode to “scene program AE” on thesetting screen of the AE mode and the scene program AE, and setting thescene program AE to “person photographing mode”. The setting conditionof the camera is recorded in the EEPROM 118, and the CPU 110 reads outthe information recorded in the EEPROM 118 to determine whether thecurrent photographing mode is set to the person photographing mode.

A button, a dial, or the like exclusively used for setting the personphotographing mode may be prepared to set the person photographing modewith these operation buttons or the like.

If the CPU 110 determines that a mode other than the personphotographing mode is set, the CPU 110 processes in accordance with theset mode.

On the other hand, if the CPU 110 determines that the personphotographing mode is set the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S11). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the CPU 110 performs the process of face detection (stepS12).

More specifically, the CPU 110 adds the image obtained for the throughdisplay to the face detection unit 164 to detect the face of the person.The CPU 110 then calculates the position and the size of the face of theperson in the image based on the detection result of the face detectionunit 164 and zooms the face such that the face will be photographed in acertain size (step S13). For example, the face is zoomed so that theratio of the face of the person relative to the entire photographed areabecomes a predetermined ratio (for example, 70% of the entire area).

For instance, the face is zoomed in the following manner. The face isgradually zoomed in predetermined steps, and in each step, the facedetection unit 164 detects the face. The zooming stops when the detectedface reaches a certain size. This allows the size of the face of theperson in the image captured by the imaging element 128 to have acertain size.

After zooming the face to make the face of the person in the image acertain size, the CPU 110 conducts the AE and AF processes to bring theperson in the image into focus and determines the exposure value so thatthe face of the person in the image has an appropriate brightness (stepS14).

The CPU 110 then determines whether the half-press of the shutter button22 is released based on the input from the operation unit 112 (stepS15). If the CPU 110 determines that the half-press of the shutterbutton 22 is not released, the CPU 110 determines whether the shutterbutton 22 is full-pressed based on the input from the operation unit 112(step S16). If the CPU 110 determines that the shutter button 22 isfull-pressed, the actual photographing is conducted (step S17). Theobtained image is subjected to image processing suitable for the personphotographing (step S18) and recorded in the memory card 146 (step S19).

On the other hand, if the CPU 110 determines that the half-press of theshutter button 22 is released at step S15, the CPU 110 determineswhether the zoom operation is conducted based on the input from theoperation unit 112 (step S20). If the CPU 110 determines that the zoomoperation is conducted, the zooming is controlled based on the operationamount (step S21).

Subsequently, the CPU 110 again determines whether the shutter button 22is half-pressed based on the input from the operation unit 112 (stepS22). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is performed (step S23), and the AE andAF processes are conducted based on the detection result (step S24).More specifically, the CPU 110 brings the detected person into focus anddetermines the exposure value so that the face of the person in theimage has an appropriate brightness.

After the AE and AF processes, the CPU 110 returns to step S15 and againdetermines whether the half-press of the shutter button 22 is releasedbased on the input from the operation unit 112 (step S15). If the CPU110 determines that the half-press of the shutter button 22 is notreleased, the CPU 110 determines whether the shutter button 22 isfull-pressed based on the input from the operation unit 112 (step S16).If the CPU 110 determines that the shutter button 22 is full-pressed,the actual photographing is conducted (step S17). The obtained image issubjected to image processing suitable for the person photographing(step S18) and recorded in the memory card 146 (step S19).

As mentioned, in the electronic camera 10 of the present embodiment, thefirst half-press of the shutter button 22 automatically zooms the face(face zooming) such that the face of the person becomes a certain size.This enables to easily and quickly photograph an image in which the faceof a person has a certain size, and enables to avoid taking time forzooming and thus missing an opportunity to press the shutter.

If modification of the composition is desired when the automatic zoomingis performed, zooming after the release of the half-press of the shutterbutton 22 allows easy modification of the composition, thereby enablingto easily photograph an image in a composition desired by thephotographer. Only a small adjustment is required in this case, enablingto quickly photograph an image in a photographer's desired composition,thereby preventing missing an opportunity to press the shutter.

The electronic camera 10 of the present embodiment is user-friendly,allowing quick zooming of the face of the person, because the face iszoomed in response to the half-press of the shutter button 22.

Additionally, an instruction button (face zooming button) for zoomingthe face may be implemented on the camera body 12 to zoom the face whenthe face zooming button is pressed.

FIG. 5 is a flow chart of the procedure of operations of photographingand recording by the electronic camera 10 when zooming the face with theface zooming button.

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S30). When a mode other than the person photographing mode is set,the process according to the set mode is performed.

On the other hand, if the CPU 110 determines that the personphotographing mode is set, the CPU 110 determines whether the face zoombutton is pressed based on the input from the operation unit 112 (stepS31).

If the CPU 110 determines that the face zoom button is pressed, the CPU110 performs the face detection (step S32). Based on the result of theface detection, the CPU 110 calculates the position and the size of theface of the person in the image and zooms the face such that the face isphotographed in a certain size (step S33).

The CPU 110 determines whether the zooming operation is conducted basedon the input from the operation unit 112 (step S34). If the CPU 110determines that the zoom operation is conducted, the zooming iscontrolled based on the operation amount (step S35).

Subsequently, the CPU 110 determines whether the shutter button 22 ishalf-pressed based on the input from the operation unit 11 (step S36).If the CPU 110 determines that the shutter button 22 is half-pressed,the face detection is conducted (step S37) and the AE and AF processesare conducted based on the detection result (step S38).

After the AE and AF processes, the CPU 110 determines whether thehalf-press of the shutter button 22 is released based on the input fromthe operation unit 112 (step S39). If the CPU 110 determines that thehalf-press of the shutter button 22 is released, the CPU 110 returns tostep S31 and again determines whether the face zoom button is pressed(step S31).

On the other hand, if the CPU 110 determines that the half-press of theshutter button 22 is not released, the CPU 110 determines whether theshutter button 22 is full-pressed based on the input from the operationunit 112 (step S40). If the CPU 110 determines that the shutter button22 is full-pressed, the CPU 110 conducts the actual photographing (stepS41). The obtained image is subjected to image processing suitable forthe person photographing (step S42) and recorded in the memory card 146(step S43).

The face may be zoomed with the face zoom button (not shown) arranged onthe camera body 12 as just described. An image in which the face of aperson is photographed in a certain size can also be easily and quicklyphotographed in this case. This also allows easy and quick modificationto the photographer's desired composition, enabling to easily photographan image in a desired composition.

The face zooming may be designed to continue until the shutter button 22is half-pressed when the person photographing mode is set.

FIG. 6 is a flow chart of the procedure of operations of photographingand recording by the electronic camera 10 when zooming the face untilthe shutter button 22 is half-pressed.

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S50). If a mode other than the person photographing mode is set,the process according to the set mode is conducted.

On the other hand, if the CPU 110 determines that the personphotographing mode is set, the face detection is conducted (step S51).The CPU 110 calculates the position and the size of the face of theperson in the image based on the detection result and zooms the facesuch that the face is photographed in a certain size (step S52).

Subsequently, the CPU 110 determines whether the shutter button 22 ishalf-pressed based on the input from the operation unit 112 (step S53).If the CPU 110 determines that the shutter button 22 is half-pressed,the face detection is conducted (step S54), and the AE and AF processesare conducted based on the detection result (step S55).

After the AE and AF processes, the CPU 110 determines whether thehalf-press of the shutter button 22 is released based on the input fromthe operation unit 112 (step S56). If the CPU 110 determines that thehalf-press of the shutter button 22 is released and determines that thezoom operation is conducted, the zooming is controlled based on theoperation amount (step S62). The CPU 110 then determines whether theshutter button 22 is half-pressed based on the input from the operationunit 112 (step S63). If the CPU 110 determines that the shutter button22 is half-pressed, the CPU 110 returns to step S54 to detect the face(step S54), and the AE and AF processes are conducted based on thedetection result (step S55). After the AE and AF processes, the CPU 110determines whether the half-press of the shutter button 22 is releasedbased on the input from the operation unit 112 (step S56).

If the CPU 110 determines that the half-press of the shutter button 22is not released, the CPU 110 determines whether the shutter button 22 isfull-pressed based on the input from the operation unit 112 (step S57).If the CPU 110 determines that the shutter button 22 is full-pressed,the CPU 110 conducts the actual photographing (step 858), and afterapplying the image processing suitable for the person photographing tothe obtained image (step S59), records the image in the memory card 146(step S60).

In this way, the face zooming may be performed until the shutter button22 is half-pressed when the person photographing mode is set. An imagein which the face of a person is photographed in a certain size can alsobe easily and quickly photographed in this case. This also allows easyand quick modification to the photographer's desired composition,enabling to easily photograph an image in a desired composition.

In the electronic camera of the above embodiment, although the facedetection is conducted in conjunction with the face zooming or the AEand AF control, the face detection may be conducted any time. Morespecifically, the face detection may be conducted sequentially or atconstant time intervals to the image obtained for the through display.During the face zooming, the detection result may be arbitrarily usedfor the face zooming.

In the electronic camera of the above embodiment, when detecting theposition and the size of the face, a so-called face recognitiontechnique is used to detect the position and the size of the face of theperson captured by the imaging element 128. However, the method ofdetecting the size of the face is not limited to this. For example, whencontinuously performing the AF process (during so-called continuous AF),the positions of the focus lens and the zoom lens may be detected, andthe size of the face of the person captured by the imaging element 128may be detected from the positions of the focus lens and the zoom lens.More specifically, the distance from the position of the focus lens infocus to the object (object distance) may be found, and the size of theface (average face size) of the person to be photographed may be foundfrom the detected object distance and the position (angle of view) ofthe zoom lens (calculated using a predetermined function or a table).When zooming the face, the zoom position in which the face of the personbecomes a certain size is calculated, and the zoom lens is moved to theposition and the zooming is performed. In this case, the face detectionis not particularly required.

In the electronic camera 10 of the above embodiment, during the facezooming, although the zooming is controlled such that the size of theface of the person becomes a certain size, it is preferable that theuser can arbitrarily set the size of the face of the person zoomedduring the face zooming. For example, an item for setting the size ofthe face of the person is preferably prepared in one of the menu itemsduring the face zooming, and when the setting item is selected, the usercan arbitrarily set the proportion (%) of the face of the personaccounted for in the image on the screen of the monitor 28 as shown inFIG. 7A, or the user can arbitrarily select from preset proportions (forexample, large (70%), medium (50%), small (30%), and so forth) on thescreen of the monitor 28 as shown in FIG. 7B. In this case, a screen forsetting the face size may be automatically displayed on the monitor 28to set the size of the face when the person photographing mode is set.

The electronic camera 10 may be designed to figure out the user'stendency of the face size setting from user's past person photographingresults and designed to automatically zoom to the size of the face highin the setting frequency. In this case, for example, the size of theface of the person is detected from the photographed image every timethe actual photographing is conducted in the person photographing mode,and the result is accumulated. The user's tendency of the face sizesetting is figured out from the accumulated data, the size of the faceof the person high in the setting frequency is estimated, and theestimated face size is set as the size of the face of the person duringthe face zooming.

The method of estimating the size of the face high in the settingfrequency from the photographing results of the past includes knownanalysis methods such as a method of finding the average and a method offinding the distribution. For example, in the method of finding theaverage, the average of the ratios of the sizes of the faces of thepersons photographed in the past in the person photographing mode isfound, and the result is defined as the size of the face high in thesetting frequency. In this case, for example, when images with faceratios of 70%, 60%, 50%, 70%, 70%, and 80% are photographed, the averageof 67% is defined as the size of the face high in the setting frequency.In the method of finding the distribution, the distribution of theratios of the sizes of the faces of the persons photographed in the pastin the person photographing mode is found, and the ratio with thehighest distribution is defined as the size of the face high in thesetting frequency. In this case, for example, when one image with faceratio of 0 to 10%, one image of 11 to 20%, one image of 21 to 30%, zeroimage of 31 to 40%, three images of 41 to 50%, three images of 51 to60%, three images of 61 to 70%, six images with 71 to 80%, four imageswith 81 to 90%, and zero image with 91 to 100% are photographed, theimages with face ratio of 71 to 80% are most frequently photographed.Thus, the intermediate value of 75% is defined as the size of the facehigh in the setting frequency.

As long as the user's tendency of the face size setting is figured outfrom the photographing results of the past and the result can bereflected to the next photographing, the specific method is notparticularly limited.

FIG. 8 is a flow chart of the procedure of operations of estimating thesize of the face high in the setting frequency based on the user'sphotographing results of the past and automatically zooming to the sizeto take a picture in the person photographing mode.

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S70). When a mode other than the person photographing mode is set,the process according to the set mode is performed.

On the other hand, if the CPU 110 determines that the personphotographing mode is set, the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S71). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S72). Morespecifically, the images obtained for the through display are added tothe face detection unit 164 to detect the face of the person. Theposition and the size of the face of the person in the image arecalculated based on the detection result of the face detection unit 164,and the face is zoomed to photograph the face in the set size (stepS73).

The size of the zoomed face is set to the size estimated as the size ofthe face high in the setting frequency from the photographing results ofthe past, which will be described below.

When the face is zoomed, the CPU 110 conducts the AE and AF processesand brings the person in the image into focus while determining theexposure value so that the face of the person in the image has anappropriate brightness (step S74).

The CPU 110 then determines whether the half-press of the shutter button22 is released based on the input from the operation unit 112 (stepS75). If the CPU 110 determines that the half-press of the shutterbutton 22 is not released, the CPU 110 determines whether the shutterbutton 22 is full-pressed based on the input from the operation unit 112(step S76).

If the CPU 110 determines that the shutter button 22 is full-pressed,the CPU 110 conducts the actual photographing (step S77). The facedetection of the photographed image is then conducted (step S78). Morespecifically, the image data obtained by photographing is added to theface detection unit 164 to extract the face area, and the position andthe size of the extracted face is found. The found position and the sizeof the face are accumulated in a predetermined database (step S79). Thedatabase is formed, for example, in the EEPROM 118 and is updated everytime the actual photographing is conducted in the person photographingmode.

Subsequently, the CPU 110 estimates the size of the face high in thesetting frequency based on the updated database (step S80) and sets theestimated size of the face as the size of the face during the facezooming (step S81). Information of the set size of the face during theface zooming is stored in the EEPROM 118. Automatic zooming to the setsize is conducted in the next photographing of a person.

After updating the database and setting the size of the face during theface zooming in such a way, the CPU 110 applies image processing to theimage obtained by the actual photographing, the image processingsuitable for the person photographing (step S82), and records the imagein the memory card 146 (step S83).

Meanwhile, at step S75, if the CPU 110 determines that the half-press ofthe shutter button 22 is released, the CPU 110 determines whether thezoom operation is conducted based on the input from the operation unit112 (step S84). If the CPU 110 determines that the zoom operation isconducted, the CPU 110 controls the zooming based on the operationamount (step S85).

The CPU 110 again determines whether the shutter button 22 ishalf-pressed based on the input from the operation unit 112 (step S86).If the CPU 110 determines that the shutter button 22 is half-pressed,the face detection is conducted (step S87) and the AE and AF processesare conducted based on the detection result (step S88). Morespecifically, the CPU 110 brings the detected person into focus anddetermines the exposure value such that the face of the person in theimage has an appropriate brightness.

After the AE and AF processes, the CPU 110 returns to step S75 and againdetermines whether the half-press of the shutter button 22 is releasedbased on the input from the operation unit 112 (step S75). If the CPU110 determines that the half-press of the shutter button 22 is notreleased, the CPU 110 determines whether the shutter button 22 isfull-pressed based on the input from the operation unit 112 (step S76).If the CPU 110 determines that the shutter button 22 is full-pressed,the actual photographing is conducted (step S77).

An image of a person in a user's desired composition can be more easilyand quickly photographed by figuring out the user's tendency of the facesize setting from the photographing results of the past and reflectingit in the next photographing.

In the above example, the face area of the person is extracted from theimage actually photographed to directly find its size when detecting thesize of the face of the person from the image actually photographed.However, the size of the face may be found based on the positioninformation of the focus lens and the position information of the zoomlens during the actual photographing.

The method of setting the face size of the person to be zoomed duringthe face zooming is not limited to this, and alternatively, for example,templates may be used for the setting. More specifically, for example, aplurality of templates with different sizes of faces are prepared asshown in FIG. 9, and the user is made to select a template for use.During the face zooming, the zooming is controlled such that the sizebecomes the same size as the face of the person in the selectedtemplate.

FIG. 10 is a flow chart of the procedure of operations when using atemplate to zoom the face.

The user first selects a template for use in the person photographingmode (step S90).

The template is selected on the menu screen in the electronic camera ofthe present embodiment. In other words, an item for selecting a templateis prepared in one of the menu items, and the template can be selectedwhen the item is selected.

As for the specific selection process of the template, availabletemplates are sequentially displayed or a list is displayed on themonitor 28 as shown in FIG. 9 to make the user select a template foruse. For example, the cross button 36, the MENU/OK button 38, and thelike are used for the selection operation.

It is assumed that a plurality of templates are prepared and stored, forexample, in the EEPROM 118 or the ROM 114.

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S91). If a mode other than the person photographing mode is set,the process according to the set mode is conducted.

On the other hand, if the CPU 110 determines that the personphotographing mode is set, the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S92). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S93). Morespecifically, the images obtained for the through display are added tothe face detection unit 164 to detect the face of the person. Theposition and the size of the face of the person in the image arecalculated based on the detection result of the face detection unit 164.The face is zoomed such that the face of the person in the photographicimage is photographed in the same size as the size of the face of theperson in the selected template (step S94).

The face is zoomed, for example, in the following manner. The face isgradually zoomed in predetermined steps, and in each step, the facedetection unit 164 detects the face. The zooming stops when the detectedface reaches the size of the face of the person in the selectedtemplate. This allows the size of the face of the person in the imagecaptured by the imaging element 128 to be adapted to the size of theface of the person in the template.

After zooming the face this way to make the face of the person in theimage to be the same size as the size of the face of the person in thetemplate, the CPU 110 conducts the AE and AF processes. Morespecifically, the CPU 110 brings the person in the image into focus anddetermines the exposure value so that the face of the person in theimage has an appropriate brightness (step S95).

Subsequently, the CPU 110 determines whether the half-press of theshutter button 22 is released based on the input from the operation unit112 (step S96). If the CPU 110 determines that the half-press of theshutter button 22 is not released, the CPU 110 determines whether theshutter button 22 is full-pressed based on the input from the operationunit 112 (step S97).

If CPU 110 determines that the shutter button 22 is full-pressed, theactual photographing is conducted (step S98). The image obtained byphotographing is subjected to image processing suitable for the personphotographing (step S99) and recorded in the memory card 146 (stepS100).

On the other hand, if the CPU 110 determines that the half-press of theshutter button 22 is released at step S96, the CPU 110 determineswhether the zoom operation is conducted based on the input from theoperation unit 112 (step S101). If the CPU 110 determines that the zoomoperation is conducted, the zooming is controlled based on the operationamount (step 102).

The CPU 110 again determines whether the shutter button 22 ishalf-pressed based on the input from the operation unit 112 (step S103).If the CPU 110 determines that the shutter button 22 is half-pressed,the face detection is conducted (step S104), and the AE and AF processesare conducted based on the detection result (step S105). Morespecifically, the CPU 110 brings the detected person into focus anddetermines the exposure value so that the face of the person in theimage has an appropriate brightness.

After the AE and AF processes, the CPU 110 returns to step S96 and againdetermines whether the half-press of the shutter button 22 is releasedbased on the input from the operation unit 112 (step S96). If the CPU110 determines that the half-press of the shutter button 22 is notreleased, the CPU 110 determines whether the shutter button 22 isfull-pressed based on the input from the operation unit 112 (step S97).If the CPU 110 determines that the shutter button 22 is full-pressed,the actual photographing is conducted (step S98).

A plurality of templates with different sizes of faces may be prepared(see, FIG. 9) in this way to make the user select a template to therebyset the size of the face of the person subject to the face zooming.

The templates may be displayed on top of each other as through-the-lensimages or may not be displayed. The user may be able to select thedisplay/nondisplay.

In the above example, although fine adjustment of the composition byuser's zoom operation is possible after the face zooming, the fineadjustment of the composition by the user's zoom operation may be madeimpossible, and the zooming may be conducted such that the face of theperson always becomes the same as the size of the face of the selectedtemplate.

FIG. 11 is a flow chart of the procedure of operations in which azooming process is always conducted such that the face of the personbecomes the size of the face of the person in the selected template.

The user first selects a template for use in the person photographingmode (step S110).

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S111). When a mode other than the person photographing mode isset, the process according to the set mode is conducted.

On the other hand, if the CPU 110 determines that the personphotographing mode is set, the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S112). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S113). Morespecifically, the images obtained for the through display are added tothe face detection unit 164 to detect the face of the person. Theposition and the size of the face of the person in the image arecalculated based on the detection result of the face detection unit 164.The face zooming is conducted such that the face of the person in thephotographic image is photographed in the same size as the size of theface of the person in the selected template (step S114).

The CPU 110 then conducts the AE and AF processes. More specifically,the CPU 110 brings the person in the image into focus and determines theexposure value such that the face of the person in the image has anappropriate brightness (step S115).

Subsequently, the CPU 110 determines whether the half-press of theshutter button 22 is released based on the input from the operation unit112 (step S116). If the CPU 110 determines that the half-press of theshutter button 22 is not released, the CPU 110 determines whether theshutter button 22 is full-pressed based on the input from the operationunit 112 (step S117).

If the CPU 110 determines that the shutter button 22 is notfull-pressed, the CPU 110 returns to step S113 and again detects theface (step S113), zoom the face (step S114), and conducts the AE and AFprocesses (step S115).

On the other hand, if the CPU 110 determines that the shutter button 22is full-pressed, the actual photographing is conducted (step S118). Theimage obtained by photographing is subjected to image processingsuitable for the person photographing (step S119) and recorded in thememory card 146 (step S120).

In this manner, the zooming may be performed such that the face of theperson always becomes the same size as the face of the selected templateduring the half-press of the shutter button 22. This enables to easilyand quickly photograph an image in a user's desired composition.

In the above example, although the zooming is conducted such that theface of the person always becomes the same as the size of the face inthe template when the shutter button 22 is half-pressed, the face may bealways zoomed regardless of the half-press of the shutter button 22.

FIG. 12 is a flow chart of the procedure of operations in which azooming process is conducted such that the face of the person alwaysbecomes the size of the face of the person in the selected template.

The user first selects a template for use in the person photographingmode (step S130).

The CPU 110 determines whether the photographing mode is set to theperson photographing mode based on the setting condition of the camera(step S131). When a mode other than the person photographing mode isset, the process according to the set mode is conducted.

On the other hand, if the CPU 110 determines that the personphotographing mode is set, the CPU 110 detects the face (step S132).More specifically the images obtained for the through display are addedto the face detection unit 164 to detect the face of the person. Theposition and the size of the face of the person in the image arecalculated based on the detection result of the face detection unit 164.The face is zoomed such that the face of the person in the photographicimage is photographed in the same size as the size of the face of theperson in the selected template (step S133).

The CPU 110 then determines whether the shutter button 22 ishalf-pressed based on the input from the operation unit 112 (step S134).If the CPU 110 determines that the shutter button 22 is half-pressed,the CPU 110 conducts the AE and AF processes (step S135). Morespecifically, the CPU 110 brings the person in the image into focus anddetermines the exposure value so that the face of the person in theimage has an appropriate brightness.

Subsequently, the CPU 110 determines whether the half-press of theshutter button 22 is released based on the input from the operation unit112 (step S136). If the CPU 110 determines that the half-press of theshutter button 22 is not released, the CPU 110 determines whether theshutter button 22 is full-pressed based on the input from the operationunit 112 (step S137).

If the CPU 110 determines that the shutter button 22 is notfull-pressed, CPU 110 returns to step S136 and again determines whetherthe half-press of the shutter button 22 is released (step S136).

On the other hand, if the CPU 110 determines that the shutter button 22is full-pressed, the CPU 110 conducts the actual photographing (stepS138). The image obtained by photographing is subjected to imageprocessing suitable for the person photographing (step S139) andrecorded in the memory card 146 (step S140).

In this manner, the zooming may be performed such that the face of theperson always becomes the same size as the face of the selected templateuntil the shutter button 22 is half-pressed. This enables to easily andquickly photograph an image in a user's desired composition.

In the above example, although the user selects one of a plurality ofprepared templates to set the size of the face of the person subject tothe face zooming, it may be designed that the size of the face of theperson in one template is arbitrarily changed within the template to setthe size of the face of the person subject to the face zooming.

More specifically, for example, an item for setting the position and thesize of the person in the template is prepared in one of the menu items,and once the item is selected on the menu screen, the position and thesize of the face of the person in the template can be arbitrarily set.

A specific setting method is shown in FIG. 13 in which a template with aframe of a person is shown on the screen of the monitor. The size of theframe is adjusted by operation of the zoom button, while the position ofthe frame is adjusted by operation of the cross button.

This enables to easily and quickly photograph an image of a person in auser's desired composition.

In photographing using the series of templates, the size of the face ofa person may be detected from the position of the focus lens in focusand the position of the zoom lens instead of using the result of theso-called face recognition.

A second embodiment of the electronic camera of the present inventionwill now be described.

Although the process of automatically zooming the face of a person whenphotographing one person as a main object is described in the firstembodiment, the process of photographing a plurality of persons will bedescribed in this embodiment. In other words, operations ofphotographing a group photo will be described.

When photographing a group photo, the electronic camera of the presentembodiment is automatically zoomed such that the persons to bephotographed are shown full screen. More specifically, whenphotographing a plurality of persons (three in FIG. 14A) as objects asshown in FIG. 14A, automatic zooming (face zooming) is conducted suchthat the faces of the persons as objects are shown full screen as shownin FIG. 14B.

The configuration itself of the camera is the same as the electroniccamera 10 of the first embodiment, and thus, only the operations inphotographing a group photo will be described herein.

The face zooming in a group photo is conducted by setting thephotographing mode of the camera to the group photo photographing mode.

FIG. 15 is a flow chart of the procedure of operations of photographingand recording by the electronic camera 10 in the group photophotographing mode.

The CPU 110 determines whether the photographing mode is set to thegroup photo photographing mode based on the setting condition of thecamera (step S150).

The setting of the group photo photographing mode is conducted byselecting an item for setting the AE mode and the scene program AE onthe menu screen, then setting the AE mode to the “scene program AE” onthe screen for setting the AE mode and the scene program AE, and settingthe scene program AE to the “group photo photographing mode”.

As described, the setting condition of the camera is recorded in theEEPROM 118. The CPU 110 reads out the information recorded in the EEPROM118 and determines whether the current photographing mode is set to thegroup photo photographing mode.

A button, a dial, or the like exclusively used for setting the groupphoto photographing mode may be prepared to set the group photophotographing mode with these operation buttons or the like.

When the CPU 110 determines that a mode other than the group photophotographing mode is set, the process according to the set mode isconducted.

On the other hand, if the CPU 110 determines that the group photophotographing mode is set, the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S51). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S152).

More specifically, the images obtained for the through display are addedto the face detection unit 164 to detect the faces of the persons. Thepositions and the sizes of the faces of the persons in the image arecalculated based on the detection result of the face detection unit 164,and the faces are zoomed so that the faces of the persons in the imageare photographed full screen (step S153).

The face is zoomed, for example, in the following manner. The faces aregradually zoomed in predetermined steps, and in each step, the facedetection unit 164 detects the faces. The zooming stops when thedetected faces have become full screen (to the extent that the faces donot extend beyond the screen). This allows the sizes of the faces of thepersons in the image captured by the imaging element 128 to be shownfull screen.

After zooming the faces this way to make the faces of the persons in theimage to be shown full screen, the CPU 110 conducts the AE and AFprocesses, brings the persons in the image into focus, and determinesthe exposure value so that the faces of the persons in the image have anappropriate brightness (step S154). The focusing herein is, for example,conducted to the person nearest to the center, or to the person with thebiggest face. The aperture value is set so that the depth of field isdeeper than usual.

The CPU 110 then determines whether the half-press of the shutter button22 is released based on the input from the operation unit 112 (stepS155). If the CPU 110 determines that the half-press of the shutterbutton 22 is not released, the CPU 110 determines whether the shutterbutton 22 is full-pressed based on the input from the operation unit 112(step S156). If the CPU 110 determines that the shutter button 22 isfull-pressed, the actual photographing is conducted (step S157). Theobtained image is subjected to image processing suitable for the personphotographing (step S158) and recorded in the memory card 146 (stepS159).

On the other hand, if the CPU 110 determines that the half-press of theshutter button 22 is released at step S155, the CPU 110 determineswhether the zoom operation is conducted based on the input from theoperation unit 112 (step S160). If the CPU 110 determines that the zoomoperation is conducted, the CPU 110 controls the zooming based on theoperation amount (step S161).

Subsequently, the CPU 110 again determines whether the shutter button 22is half-pressed based on the input from the operation unit 112 (stepS162). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S163) and the AE andAF processes are conducted based on the detection result (step S164).More specifically, the CPU 110 brings the persons in the image intofocus and determines the exposure value such that the faces of thepersons in the image have an appropriate brightness.

After the AE and AF processes, the CPU 110 returns to step S155 andagain determines whether the half-press of the shutter button 22 isreleased based on the input from the operation unit 112 (step S155). Ifthe CPU 110 determines that the half-press of the shutter button 22 isnot released, the CPU 110 determines whether the shutter button 22 isfull-pressed based on the input from the operation unit 112 (step S156).If the CPU 110 determines that the shutter button 22 is full-pressed,the actual photographing is conducted (step S157). The obtained image issubjected to image processing suitable for the person photographing(step S158) and recorded in the memory card 146 (step S159).

As mentioned, in the electronic camera 10 of the present embodiment, thefirst half-press of the shutter button 22 automatically zooms the faces(face zooming) such that the faces of the persons to be photographed areshown full screen. This enables to easily and quickly photograph a groupphoto in which the faces of persons have appropriate sizes.

If modification of the composition is desired when the automatic zoomingis performed, zooming after the release of the half-press of the shutterbutton 22 allows easy modification of the composition, thereby enablingto easily photograph an image in a composition desired by thephotographer.

An image in a photographer's desired composition can quickly takenbecause only a small adjustment is required in this adjustmentoperation, preventing missing an opportunity to press the shutter.

The electronic camera 10 of the present embodiment is user-friendly,allowing quick zooming of the faces of the persons, because the facesare zoomed in response to the half-press of the shutter button 22.

As in the case of the person photographing mode, an instruction button(face zooming button) for zooming the faces may be additionally arrangedon the camera body 12 to zoom the faces when the face zooming button ispressed in the group photo photographing mode (see, FIG. 5).

As in the case of the person photographing mode, the faces may be zoomeduntil the shutter button 22 is half-pressed once the group photophotographing mode is set (see, FIG. 6).

In the above example, although the user can finely adjust the zoomposition after the face zooming, the fine adjustment may be madeimpossible such that the face zooming is always conducted. Morespecifically, the zooming process may be designed in such a manner thatthe faces are always zoomed after the half-press of the shutter button22 so that the faces of the persons in the image are always shown fullscreen. The zooming process may also be designed in such a manner thatthe faces are always zoomed regardless of the half-press of the shutterbutton 22 so that the faces of the persons in the image are always shownfull screen.

In the above example, although the face detection is conducted inconjunction with the face zooming or the AE and AF control, the facedetection may be conducted arbitrarily. More specifically, the facedetection may be conducted sequentially or at constant time intervals tothe image obtained for the through display. During the face zooming, thedetection result may be arbitrarily used for the face zooming.

In the above example, although the zooming is controlled such that thefaces of the persons are photographed full screen during the facezooming, it is preferable that the user can arbitrarily set the range ofillustrating the faces. For example, an item for setting the range ofillustrating the faces of the persons in the group photo photographingmode is prepared as one of the menu items, and once this setting item isselected, the range of illustrating the faces of the persons can bearbitrarily set on the screen of the monitor 28, as shown in FIGS. 16Aand 16B.

In the example shown in FIG. 16A, a frame indicating the range ofillustrating the faces of the persons is shown on the screen of themonitor 28, and the size of the frame is designed to be expanded andcontracted with the zoom button.

In the example of FIG. 16B, a frame indicating the range of illustratingthe faces of the persons on the screen of the monitor 28 is shown. Thesize of the frame is designed to be expanded and contracted with thezoom button, while the position of the frame is designed to be set withthe cross button.

When setting the size of the frame for illustrating the faces of thepersons, user's photographing results of group photos of the past may bereflected to automatically set the size of the frame. More specifically,as in the case of automatically setting the size of the face of theperson subject to the face zooming by figuring out the tendency of theface size setting from the photographing results of the past in theperson photographing mode, the size of the frame high in the settingfrequency may be automatically set by figuring out the user's tendencyof the frame size setting from the user's photographing results of groupphotos of the past.

A template may be used for zooming the faces in accordance with thetemplate, instead of zooming the faces in accordance with the screen orthe frame. More specifically, for example, a plurality of templates withdifferent distributions (positions and sizes) of faces for each of thenumbers of persons photographed are prepared as shown in FIG. 17, andthe user is made to select a template for use. During the face zooming,the zooming is controlled so that the distribution becomes substantiallythe same as the distribution of the faces of the persons in the selectedtemplate.

FIG. 18 is a flow chart of the procedure of operations when zooming thefaces in a group photo using a template.

The user first selects a template for use in the group photographingmode (step S170).

The template is selected on the menu screen in the electronic camera ofthe present embodiment. In other words, an item for selecting a templateis prepared as one of the menu items, and the template can be selectedwhen the item is selected.

As for the specific selection process of the template, availabletemplates are sequentially displayed or a list is displayed on themonitor 28 as shown in FIG. 17 to make the user select a template foruse. For example, the cross button 36, the MENU/OK button 38, and thelike are used for the selection operation.

It is assumed that a plurality of templates are prepared and stored, forexample, in the EEPROM 118 or the ROM 114.

The CPU 110 determines whether the photographing mode is set to thegroup photo photographing mode based on the setting condition of thecamera (step S171). When a mode other than the group photo photographingmode is set, the process according to the set mode is conducted.

On the other hand, if the CPU 110 determines that the group photophotographing mode is set, the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S172). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S173). Morespecifically, the images obtained for the through display are added tothe face detection unit 164 to detect the faces of the persons. Thepositions and the sizes of the faces of the persons in the image arecalculated based on the detection result of the face detection unit 164.The faces are zoomed such that the faces of the persons in thephotographic image have substantially the same distribution of the facesof the persons in the selected template (step S174).

The faces are zoomed, for example, in the following manner. The facesare gradually zoomed in predetermined steps, and in each step, the facedetection unit 164 detects the faces. The zooming stops when thedetected faces have substantially the same distribution of the faces ofthe persons in the selected template. This allows the distribution ofthe faces of the persons in the image captured by the imaging element128 to be adapted to the distribution of the faces of the persons in thetemplate.

The distribution of the faces of the persons is adapted to thedistribution of the faces of the persons in the template in this way.Thus, the persons as objects are photographed side by side insubstantially the same alignment as the persons in the template.

After zooming the faces to make the faces of the persons in the image tohave substantially the same distribution of the faces of the persons inthe template, the CPU 110 conducts the AE and AF processes. Morespecifically, the CPU 110 brings the persons in the image into focus anddetermines the exposure value so that the faces of the persons in theimage have an appropriate brightness (step S175).

The CPU 110 then determines whether the half-press of the shutter button22 is released based on the input from the operation unit 112 (stepS176). If the CPU 110 determines that the half-press of the shutterbutton 22 is not released, the CPU 110 determines whether the shutterbutton 22 is full-pressed based on the input from the operation unit 112(step S177).

If the CPU 110 determines that the shutter button 22 is full-pressed,the CPU 110 conducts the actual photographing (step S178). The imageobtained by photographing is subjected to image processing suitable forthe person photographing (step S179) and recorded in the memory card 146(step S180).

On the other hand, if the CPU 110 determines that the half-press of theshutter button 22 is released at step S176, the CPU 110 determineswhether the zoom operation is conducted based on the input from theoperation unit 112 (step S181). If the CPU 110 determines that the zoomoperation is conducted, the zooming is controlled based on the operationamount (step S182).

Subsequently, the CPU 110 again determines whether the shutter button 22is half-pressed based on the input from the operation unit 112 (stepS183). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the face detection is conducted (step S184), and the AEand AF processes are conducted based on the detection result (stepS185). More specifically, the CPU 110 brings the detected persons intofocus and determines the exposure value such that the faces of thepersons in the image have an appropriate brightness.

After the AE and AF processes, the CPU 110 returns to step S176 andagain determines whether the half-press of the shutter button 22 isreleased based on the input from the operation unit 112 (step S176). Ifthe CPU 110 determines that the half-press of the shutter button 22 isnot released, the CPU 110 determines whether the shutter button 22 isfull-pressed based on the input from the operation unit 112 (step S177).If the CPU 110 determines that the shutter button 22 is full-pressed,the actual photographing is conducted (step S178).

A plurality of templates with different distributions (positions andsizes) of faces may be prepared in this manner for each of the numbersof faces (see, FIG. 17). The user is made to select a template, and theautomatic zooming is conducted so as to adapt to the distribution of thefaces of the persons in the selected template. This enables to easilyand quickly photograph an image in a desired composition.

The templates may be displayed on top of each other as through-the-lensimages or may not be displayed. The user may be able to select thedisplay/nondisplay.

In the above example, although fine adjustment of the composition byuser's zoom operation is possible after the face zooming, the fineadjustment of the composition by the user's zoom operation may be madeimpossible, and the zooming may be conducted such that the distributionof the faces of the persons always becomes substantially the same as thedistribution of the faces of the selected template (see, FIG. 11).

In this case, the zooming may be conducted such that the distribution ofthe faces of the persons is always substantially the same as thedistribution of the faces of the persons in the template when theshutter button 22 is half-pressed, or the faces may be zoomed such thatthe distribution of the faces of the persons is always substantially thesame as the distribution of the faces of the persons in the templateregardless of the half-press of the shutter button 22 (see, FIG. 12).

In the above example, although the user selects one from the pluralityof prepared templates and automatic zooming is performed for adapting tothe distribution of the faces of the persons in the template, the methodof setting the template for use is not limited to this. For example, atemplate for use may be set by preparing templates for each of thenumbers of persons, thereby allowing an arbitrary change in thepositions and the sizes of the faces of the persons in the template.

More specifically, for example, an item for setting the positions andthe sizes of the persons in the template is prepared in one of the menuitems, and once the item is selected on the menu screen, the positionsand the sizes of the persons in the template can be arbitrarily set.

A specific setting method is shown as an example in FIG. 19A in whichthe number of persons to be photographed is first selected. Then, atemplate corresponding to the selected number of persons is shown on thescreen of the monitor as shown in FIG. 19B, and the size of the frame ofeach person is adjusted with the zoom button, while the position isadjusted with the cross button.

Enabling to change the distribution of the persons in the template inaccordance with the user's preference allows easy and quickphotographing of a group photo in a user's desired composition.

When adapting the distribution of the faces of the persons to bephotographed to the distribution of the faces of the persons in thetemplate, the zooming may be conducted so that only the sizes of thefaces are adapted to the sizes of the faces of the persons in thetemplate. In other words, after detecting the positions and the sizes ofthe faces of the persons in the image by the face detection, the zoomingmay be conducted such that the sizes of the detected faces of thepersons substantially match with the sizes of the faces of the personsin the template. In this case, the sizes of the faces may be found fromthe position of the focus lens in focus and the position of the zoomlens to conduct the zooming process based on the result, instead ofusing the result of the so-called face recognition. The face detectionunit does not have to be particularly provided when using this method.

In the above example, the mode of the camera is set to the group photomode for zooming the faces during the group photo. However, when theperson photographing mode is set, the mode may be automatically switchedto the group photo photographing mode if a plurality of persons aredetected. In other words, in the person photographing mode, theprocesses in the person photographing mode are implemented when only onemain object is detected as a result of the face detection. When aplurality of persons are detected, the processes in the group photophotographing mode are implemented. This allows arbitrary, optimalzooming in accordance with the number of persons photographed.

Although so-called optical zooming is performed in the first and secondembodiments, so-called electronic zooming may be performed. Both of theelectronic zooming and the optical zooming may also be performed.

A third embodiment of the electronic camera of the present inventionwill now be described.

In the second embodiment, a template is elected, and automatic zoomingis conducted to adapt to the distribution of the persons in the templateto thereby obtain an image in a predetermined composition. However, inthis embodiment, a template is selected, and the image obtained byphotographing is automatically cropped after photographing so as toadapt to the distribution of the persons in the template, to therebyobtain an image in a predetermined composition. More specifically, whena template of three persons as shown in FIG. 20A is selected and theimage as shown in FIG. 20B is photographed, an image which substantiallymatches with the composition of the selected template is cut out, asshown in FIG. 20C, from the image obtained by photographing, and this isrecorded as a photographic image.

The configuration itself of the camera is the same as the electroniccamera 10 of the first embodiment, and thus, only the operations ofphotographing and recording will be described herein.

FIG. 21 is a flow chart of the procedure of the operations ofphotographing and recording in the group photo photographing mode of theelectronic camera according to the present embodiment.

The user first selects a template for use in the group photographingmode (step S190). The method of selecting the template is the same asthe method of selecting a template in the second embodiment.

The CPU 110 determines whether the photographing mode is set to thegroup photo photographing mode based on the setting condition of thecamera (step S191). When a mode other than the group photo photographingmode is set, the process according to the set mode is conducted.

On the other hand, if the CPU 110 determines that the group photophotographing mode is set, the CPU 110 determines whether the shutterbutton 22 is half-pressed based on the input from the operation unit 112(step S192). If the CPU 110 determines that the shutter button 22 ishalf-pressed, the AE and AF processes are conducted (step S193).

The CPU 110 then determines whether the half-press of the shutter button22 is released based on the input from the operation unit 112 (stepS194). If the half-press of the shutter button 22 is released, the CPU110 returns to the process of step S192 and again detects whether theshutter button 22 is half-pressed.

Meanwhile, if the CPU 110 determines that the half-press of the shutterbutton 22 is not released, the CPU 110 determines whether the shutterbutton 22 is full-pressed based on the input from the operation unit 112(step S195).

If the CPU 110 determines that the shutter button 22 is full-pressed,the CPU 110 conducts the actual photographing (step S196). The faces ofthe persons are detected from the obtained image (step S197). In otherwords, the image data obtained by photographing is added to the facedetection unit 164 to extract the face area. The positions and the sizesof the faces of the persons in the image are calculated based on theextraction result.

After detecting the faces, the CPU 110 applies image processing suitablefor the person photographing to the photographic image based on theresult of the face detection (step S198).

The CPU 110 cuts out an image having a composition substantially thesame as the distribution of the faces of the persons in the selectedtemplate based on the result of the face detection. In other words thecropping process is conducted (step S199).

The image signal processing unit 138 conducts the cropping process basedon an instruction from the CPU 110. The CPU 110 calculates the areanecessary for cropping from the result of the face detection andprovides an instruction of cropping to the image signal processing unit138. In response to the instruction of cropping from the CPU 110, theimage signal processing unit 138 cuts out the designated area from thephotographic image and conducts the cropping process.

The cropped image data is recorded in the memory card 146 as aphotographic image (step S200). More specifically, the cropped imagedata is compressed and then recorded in the memory card 146 as an imagefile in a predetermined form.

As mentioned, in the electronic camera of the present embodiment, theimage obtained by photographing is automatically cropped to adapt to thecomposition of the selected template, and the cropped image is recordedin a memory card as a photographic image. This enables to easily andquickly photograph a group photo in a user's desired composition withoutcumbersome zoom operation.

In the electronic camera of the present embodiment, the photographicimage is cropped to adapt to the composition of the template. Thus, thepersons as objects need to line up in a composition substantially thesame as the composition of the template.

If the alignment of the persons in the photographed image issignificantly deviated from the alignment of the persons in thetemplate, the photographed image is recorded as is, without cropping. Inthis case, the fact that the cropping process was not conducted may beannounced.

When photographing in the actual photographing mode, the image size(resolution and the number of pixels) is preferably automaticallyswitched to the maximum image size because the cropping process isconducted as described.

The templates may be displayed on top of each other as through-the-lensimages or may not be displayed. The user may be able to select thedisplay/nondisplay.

In the above example, the user selects one from a plurality of preparedtemplates to conduct the cropping process to adapt to the composition inthe template. However, the method of setting a template for use in notlimited to this. For example, a template for use may be set by preparingtemplates for each of the numbers of persons and by allowing anarbitrary change in the positions and the sizes of the faces of thepersons in the template (see, FIG. 19).

Although the photographic image is automatically cropped to adapt to thecomposition of the template in the above example, the photographic imagemay be automatically cropped such that the persons are shown fullscreen. The automatic cropping may be conducted such that the personsare fully illustrated within a preset frame.

In the series of embodiments, although examples have been described inwhich the present invention is applied to an electronic camera,applications of the present invention are not limited to this. Thepresent invention can be applied to all devices equipped with aphotographing function such as a cellular phone with a camera.

1. An image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein a telephoto direction or a wide angle direction; a mode settingdevice which sets a person photographing mode; a detection device whichdetects a size of a face of a person captured by the image pickup devicein the person photographing mode; a face zooming instruction devicewhich instructs zooming of the face of the person by the zooming devicein the person photographing mode; and a control device which controlsthe zooming device in response to an instruction from the zoominginstruction device and which controls the zooming device such that thesize of the face of the person captured by the image pickup devicebecomes a certain size based on the detection result of the detectiondevice when zooming to the face of the person is instructed from theface zooming instruction device in the person photographing mode.
 2. Theimage taking apparatus according to claim 1, further comprising asetting device which sets a size of a face of a person to bephotographed by the image pickup device, wherein the control devicecontrols the zooming device such that the size of the face of the personcaptured by the image pickup device becomes the size set by the settingdevice.
 3. The image taking apparatus according to claim 1, furthercomprising: a second detection device which detects the size of the faceof the person captured by the image pickup device in the personphotographing mode; and an estimation device which estimates the size ofthe face of the person high in the photographing frequency based on thedetection result of the second detection device, wherein the controldevice controls the zooming device such that the size of the face of theperson captured by the image pickup device becomes the size estimated bythe estimation device.
 4. An image taking apparatus which records animage captured by an image pickup device in a recording medium inresponse to an image recording instruction, the image taking apparatuscomprising: a zooming device; a zooming instruction device whichinstructs zooming by the zooming device in a telephoto direction or awide angle direction; a mode setting device which sets a groupphotographing mode; a detection device which detects positions and sizesof faces of persons captured by the image pickup device in the groupphotographing mode; a face zooming instruction device which instructszooming to the faces of the persons by the zooming device in the groupphotographing mode; and a control device which controls the zoomingdevice in response to an instruction from the zooming instruction deviceand which controls the zooming device such that the faces of the personscaptured by the image pickup device are shown full screen based on thedetection result of the detection device when zooming to the faces ofthe persons is instructed from the face zooming instruction device inthe group photographing mode.
 5. An image taking apparatus which recordsan image captured by an image pickup device in a recording medium inresponse to an image recording instruction, the image taking apparatuscomprising: a zooming device; a zooming instruction device whichinstructs zooming by the zooming device in the telephoto direction orthe wide direction; a mode setting device which sets a personphotographing mode; a template recording device which is recorded with aplurality of person photographing templates with different sizes offaces; a selection device which selects a template for use in the personphotographing mode; a detection device which detects a size of a face ofa person captured by the image pickup device in the person photographingmode; a face zooming instruction device which instructs zooming of theface of the person by the zooming device in the person photographingmode; and a control device which controls the zooming device in responseto an instruction from the zooming instruction device and which controlsthe zooming device such that the size of the face of the person capturedby the image pickup device becomes the same as a size of a face of aperson in the template selected by the selection device based on thedetection result of the detection device when zooming to the face of theperson is instructed by the face zooming instruction device in theperson photographing mode.
 6. An image taking apparatus which records animage captured by an image pickup device in a recording medium inresponse to an image recording instruction, the image taking apparatuscomprising: a zooming device; a zooming instruction device whichinstructs zooming by the zooming device in a telephoto direction or awide angle direction; a mode setting device which sets a personphotographing mode; a template recording device which is recorded with aperson photographing template for use in the person photographing mode;a setting device which sets a size of a face of a person in thetemplate; a detection device which detects a size of a face of a personcaptured by the image pickup device in the person photographing mode; aface zooming instruction device which instructs zooming of the face ofthe person by the zooming device in the person photographing mode; and acontrol device which controls the zooming device in response to aninstruction from the zooming instruction device and which controls thezooming device such that the size of the face of the person captured bythe image pickup device becomes the same as the set size of the face ofthe person in the template based on the detection result of thedetection device when zooming to the face of the person is instructed bythe face zooming instruction device in the person photographing mode. 7.An image taking apparatus which records an image captured by an imagepickup device in a recording medium in response to an image recordinginstruction, the image taking apparatus comprising: a zooming device; azooming instruction device which instructs zooming by the zooming devicein the telephoto direction or the wide direction; a mode setting devicewhich sets a group photographing mode; a template recording device whichis recorded with a plurality of group photographing templates withdifferent distributions of the faces of persons; a selection devicewhich selects a template for use in the group photographing mode; adetection device which detects positions and sizes of faces of personscaptured by the image pickup device in the group photographing mode; aface zooming instruction device which instructs zooming of the faces ofthe persons by the zooming device in the group photographing mode; and acontrol device which controls the zooming device in response to aninstruction from the zooming instruction device and which controls thezooming device such that a distribution of the faces of the personscaptured by the image pickup device approaches the distribution of thefaces of the persons in the template selected by the selection devicebased on the detection result of the detection device when zooming tothe faces of the persons is instructed by the face zooming instructiondevice in the group photographing mode.
 8. An image taking apparatuswhich records an image captured by an image pickup device in a recordingmedium in response to an image recording instruction, the image takingapparatus comprising: a zooming device; a zooming instruction devicewhich instructs zooming by the zooming device in the telephoto directionor the wide direction; a mode setting device which sets a groupphotographing mode; a template recording device which is recorded with aplurality of group photographing templates with different numbers ofpersons; a selection device which selects a template for use in thegroup photographing mode; a setting device which sets positions andsizes of faces of persons in the template selected by the selectiondevice; a detection device which detects positions and sizes of faces ofpersons captured by the image pickup device in the group photographingmode; a face zooming instruction device which instructs zooming of thefaces of the persons by the zooming device in the group photographingmode; and a control device which controls the zooming device in responseto an instruction from the zooming instruction device and which controlsthe zooming device such that the distribution of the faces of thepersons captured by the image pickup device approaches the distributionof the faces of the persons in the template selected by the selectiondevice based on the detection result of the detection device whenzooming to the faces of the persons is instructed by the face zoominginstruction device in the group photographing mode.
 9. The image takingapparatus according to claim 1, comprising a two-step stroke shutterbutton operable to half-pressing and full-pressing, wherein thehalf-pressing of the shutter button instructs the zooming device to zooma face of a person, while the full-pressing of the shutter buttoninstructs recording of an image.
 10. The image taking apparatusaccording to claim 4, comprising a two-step stroke shutter buttonoperable to half-pressing and full-pressing, wherein the half-pressingof the shutter button instructs the zooming device to zoom a face of aperson, while the full-pressing of the shutter button instructsrecording of an image.
 11. The image taking apparatus according to claim5, comprising a two-step stroke shutter button operable to half-pressingand full-pressing, wherein the half-pressing of the shutter buttoninstructs the zooming device to zoom a face of a person, while thefull-pressing of the shutter button instructs recording of an image. 12.The image taking apparatus according to claim 6 comprising a two-stepstroke shutter button operable to half-pressing and full-pressing,wherein the half-pressing of the shutter button instructs the zoomingdevice to zoom a face of a person, while the full-pressing of theshutter button instructs recording of an image.
 13. The image takingapparatus according to claim 7, comprising a two-step stroke shutterbutton operable to half-pressing and full-pressing, wherein thehalf-pressing of the shutter button instructs the zooming device to zooma face of a person, while the full-pressing of the shutter buttoninstructs recording of an image.
 14. The image taking apparatusaccording to claim 8, comprising a two-step stroke shutter buttonoperable to half-pressing and full-pressing, wherein the half-pressingof the shutter button instructs the zooming device to zoom a face of aperson, while the full-pressing of the shutter button instructsrecording of an image.
 15. An image taking apparatus which records animage captured by an image pickup device in a recording medium inresponse to an image recording instruction, the image taking apparatuscomprising: a mode setting device which sets a group photographing mode;a template recording device which is recorded with a plurality of groupphotographing templates with different distributions of the faces ofpersons; a selection device which selects a template for use in thegroup photographing mode; a detection device which detects positions andsizes of faces of persons from an image captured by the image pickupdevice in the group photographing mode; and an image processing devicewhich cuts out an image having a substantially the same composition as adistribution of the faces of the persons in the template selected by theselection device from the image captured by the image pickup devicebased on the detection result of the detection device in the groupphotographing mode, wherein the image cut out by the image processingdevice is recorded in the recording medium in the group photographingmode.
 16. An image taking apparatus which records an image captured byan image pickup device in a recording medium in response to an imagerecording instruction, the image taking apparatus comprising: a modesetting device which sets a group photographing mode; a templaterecording device which is recorded with a plurality of groupphotographing templates with different numbers of persons; a selectiondevice which selects a template for use in the group photographing mode;a setting device which sets positions and sizes of faces of persons inthe template selected by the selection device; a detection device whichdetects positions and sizes of faces of persons captured by the imagepickup device in the group photographing mode; and an image processingdevice which cuts out an image having a substantially the samecomposition as a distribution of the faces of the persons in thetemplate selected by the selection device from the image captured by theimage pickup device based on the detection result of the detectiondevice in the group photographing mode, wherein the image cut out by theimage processing device is recorded in the recording medium in the groupphotographing mode.